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Trainable User Interface Translator 
Background 

This invention relates to integrating and translating 
software application user interfaces from a targeted con5)uter 
system to a new computer system without modifying the 
underlying application. 

Software developers, system integrators, value added 
resellers cOid end users are eager to utilize the leading edge 
handheld computers and portcible data collection terminals. 
Yet, incorporating these new devices into existing software 
systems has proven difficult primarily because the computer 
system nmning the application must provide a user interface 
with a minimxim fiinctionality . For instance, an inventory 
system' s user interface may require a screen capable of 
displaying 24 lines by 80 characters. Yet, a portable 
terminal may only provide 4 lines by 40 characters, and 
therefore be incapable of directly running the application. 
Since handheld or portable terminals typically do not provide 
the required minimum functionality, they are not capable of 
running most current applications. 

The traditional solutions to this problem included 
rewriting the old application, buying a new application suited 
to the portable terminal restrictions, or writing a custom 
mapping program that would "map" the fields, prompts and 
responses from their respective positions on the targeted 
computer display to the more usable positions on the portable 
device. Rewriting the old application takes time, costs money 
and risks the introduction of bugs into the existing system. 
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Buying a new application involves significant eaqpense and 
risk, i 

Custom mapping programs are expensive and time consiiming 
to create and increase the maintenance cost of the application 
as changes in the application program could require further 
changes in the custom mapping program. In addition, custom 
mapping programs can create synchronization problems. The 
need to synchronize becomes obvious when you think about the 
impact of an error message not being seen by an operator who 
continues to type ahead. Therefore, custom mapping programs 
are not a satisfactory solution to the problem. 

The present invention solves this problem by acting as an 
intelligent trainable interface between an existing 
application and a new computer system. The result is that the 
present invention allows the use of existing computer software 
with hardware for which it was not originally designed. 
Specifically, it provides a means of interfacing with the 
existing program, processing the data from the display screens 
of that existing program and presenting these data to, the user 
in a different manner and/ or format. Similarly, it accepts 
data from the user, reformats the data if necessary, and 
presents the re-formatted data to the existing application. 

One goal of the present invention is to provide a system 
that can translate or convert an existing software 
application's user interface, so as to operate on a new 
computer system. In addition, it is a goal of the present 
invention to provide a system that utilizes a simple scheme to 
educate or train the system to translate an existing software 
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application's user interface. A further goal of the invention 
is to provide synchronization mechanisms to sync operation of 
a portsQDle device to that of an existing software application. 
An additional goal of the invention is to provide robust error 
handling of application errors. 

Sounmary of the Invention 

By means of this invention, existing application software 
may be utilized on a system which does not provide the 
required level of user interface functionality. 

The invention discloses an trainable apparatus for 
translating an existing software application's user interface. 
The apparatus comprises a computer adapted to communicate with 
both a host computer and client computer. The apparatus 
intercepts the host computer' s input /output stream and 
translates the application user interface into a client user 
interface for use on the client cort^juter. . The computer is 
additionally adapted to simplify user interactions with the 
application by hiding repetitive tasks and redundant 
information conveyed by the application user interface. The 
computer is further adapted to unify host applications into a 
single user interface. 

A method of creating and training the apparatus is also 
disclosed. The apparatus is trained by the monitoring of a 
user's interaction's with the application. The monitoring 
process creates a path history utilized by the apparatus for 
translating the application user interface. 
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Bri £ Description of the Drawings 

Fig. 1 is a block diagram of a prior art computer system 
utilizing handheld or portable terminals. 

Fig, 2 is a diagram illustrating the functional 
difference between a portable terminal and a terminal targeted 
by the application. 

Fig. 3 is a block diagram of a computer system utilizing 
the invention to interface to portable terminals. 

Fig, 4 is a block diagram of the Virtual User paths 
created during the education process. 

Figs. A-KK are screen printouts of one embodiment of the 
present invention. 

Detailed Description of the Preferred Embodiment 

Fig. 1 shows a prior art computer system using a portable 
terminal. A computer system 10 runs an application 12 
specifically designed for a portable terminals 16. This 
application 12 interacts with the user 14 through the portable 
terminal 16. The application 12 communicates with the 
portable terminal 16 through a communications medium 18 such 
as infrared, radio frequency or even direct wire. The 
portable terminal 16 displays to the user 14 prompts 
requesting specific information. The user 14 enters replies 
into the portable terminal 16 in response to these requests. 

If the application program is not designed to run on the 
portable terminal, the user will be unable to interact with 
the application. For instance, referring to Fig. 2, the 
application may require a terminal 20 with a full size 
keyboard 21 including functions keys, which keyboard is 
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different from the keyboard 23 available on the portable 
terminal 22. The application may also rec|[uire a terminal 24 
whose screen size is larger than the screen 25 on the portable 
terminal 22 • In either situation, the application will be 
unable to run on the portable terminal without some form of 
change to the system. 

Fig. 3 shows a computer system utilizing the present 
invention. A computer system 3 0 runs an application 32 that 
is not designed for use with a portable terminal. The present 
invention 34 is interposed between the application 32 and the 
portable terminal 36. The application 32 communicates through 
communications medium 33 with the present invention 34 which 
in turn communicates with the portable terminals 36 through a 
communications medium 38. Again, the portable terminal 3 6 
displays to the user 39 prompts requesting specific 
information, but these prompts are generated by the present 
invention 34 and not the underlying application 32. The user 
39 enters replies into the portable terminal 36 in response to 
these prompts, but these replies are again captured by the 
invention 34 and not necessarily passed directly to the 
application 32. 

The present invention may reside on the same computer 
system as the underlying application program or may reside in 
a separate computer system and communicate with the; 
application program through a network. In either situation, 
the present invention intercepts the I/O stream and translates 
the user interface for use on the portable terminal. The 
present invention may also be used to simplify access to an 
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existing program or group of programs even though access is 
through the same computer system as that of the existing 
program (s) * 

In order to interface and translate between an existing 
application and a portable terminal, the present invention 
creates a Virtual User (VU) • A VU appears to the existing 
application as a real user. The VU is trained to operate the 
existing application, just as a real user would, and to 
present data to the real user in a format compatible with a 
portable terminal . 

The VU is created, prior to use in the final system, by 
monitoring the interactions of a human user while operating 
the application. In the background, the present invention is 
creating a "path file" that the VU will use to automatically 
navigate through the particular task in the application. The 
path file consists of a series of automatically generated 
"steps" created during the training process that the VU later 
executes in a linear or branched sequence so as to move around 
the application.' Every cursor stop in an application is 
reviewed by the VU and at least one step, possibly a series of 
steps, is associated with the stop. 

The present invention provides three features to 
facilitate the creation of the VU. First, the present 
invention utilizes a menu driven interface to facilitate the 
process of creating the VU, making the process interactive as 
opposed to /off line". The user is not required to program in 
the classical sense, but rather just to interact with the 
application. 
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Second, the VU can create and utilize functions not 
available on the xinderlying application. Because the present 
, invention is simply following a pre-defined set of steps, any 

combination of keystrokes a person can enter, a VU can also. 
5 This allows the VU to be trained or educated to navigate 
around the entire application, enter and exit different 
applications, and even access and exit different hosts. For 
example, an application may have two menu options: the first 
menu would list the quantity of item on hand and second menu 
10 would list the location of item. A typical user directly 

accessing the application would have to enter the first menu 
option to get the quantity, exit the first menu option, enter 
the second menu option to get the location just to get both 
pieces of information. The VU can be trained to do the same 
15 steps but present the user with one screen that has both 

pieces of information. Therefore, the present invention can 
create new functions for a user that were not previously 
availcdjle by running a particular application "straight 
through as written" . 
20 Third, the present invention provides streams monitoring 

that allows the VU to synchronize itself with the application. 
The VU must be synchronized with every application cursor stop 
prior to sending any keystrokes back to the host. The use of 
. streams monitoring allows the VU to "recognize" the current 

25 cursor position and hence determine on what screen of the 
application it is "looking at". 
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Creatina and Educating the Virtual User 

In order to translate an applications user interface, the 
VU must be created and educated » 

The following is a list of all the commands accessible 
5 from FILE, VARS, HOST, CLIENT and MISC selections of the menu 
bar i\of the present invention during the education process. 



FILE MENU 

Save path File 



10 



15 



Save & Exit 
Quit 

Save Window 



: save the steps that you have 

created to the patiz file, without 
exiting 

: save the path file cuid exit 
: exit without saving 

: allows you to save the image of any 
screen for later printing 



20 



VARS MENU 

Declare Variable 

Set Variable 

Branch on VaricJ^le 



25 



: declare a varicible to be used in 

the path file you will create 
: initialize a variable already 

declared to a starting value 
: define the pati2 name the program 
will branch to when a variable 
equals the "to match" filed defined 
here. NOTE: "No." selects the 
step # in the path. 
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HOST MENU (first time) 

Cozmect Local (PTY) : 



Connect Local (Pipe) 



Connect via TELNET- : 



Connect via Serial : 



HOST MENU 

Send to Host 

Wait for Host 



Save Host Screen Data 



-9- 

def ines connection method to host 
application as pseudo termlnaJ 
access to the same computer the VU 
is running on. 

: defines connection method to 
host application is via a pipe to 
the same computer the VU is running 
on, 

defines connection method to host 
application is via telnet, in this 
case the application is running on 
different computer them the VU* 
defines connection method to host 
application is via a aerial port on 
the computer the VU is running. 

send any combinations of keystrokes 
to the host 

synchronization step that makes 
sure the VU and the host 
application are at the exact same 
character of a given application at 
a given time 

: save a particular window of the 
host screen, often used to store 
error messages that appear on the 
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same line of the screen every time. 



Bypass Virtual User : 

5 

CLIEITT MENU 

Clear Screen : 

10 Sound Tone : 

Move Cursor : 

15 Send Message : 

Get Reply : 

20 MISC MENU 

Start New Path 



25 End Patli 

Connect (Loop) 



allows you to stop the interactive 
training and key data directly into 
the host application, 

send the command sequence to clear 
the screen 

send the command sequence to sound 
the bell tone 

send the command sequence to move 
the cursor to a specific x, y 
coordinate of the Client screen 
send a string of characters to the 
Client for display 
rec[uest a reply from the Client 
(Scanner or keyboard input) 

defines the current step as the 
beginning of a path, used as the 
coimectlon point when using the 
ccmnect statement below, 
defines the end to a path 
allows program flow to be . 
redirected to a path label 
specified using the "Start New 
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Path" option eibove* 
: allows program control to pass to a 
pre-defined procedure, procedures 
are available for Texminal Mode, 
Logon, etc. 

By selecting various options from the menu bar defined 
above, one can access the application for which the VU will be 
trained. After accessing the application, one can 
interactively train the VU to react appropriately to. prompts 
in the application. 

An in^ortant concept is appllcatilon program flow» 
Application program flow is the sequence of data input prompts 
that must be followed for use of a particular application. 
These pronqpts include menu selections, data and time entries, 
and other inputs as is required in order to operate an 
application. The present invention provides a method of pre- 
defining and remembering how someone interacts (e.g. a Virtual 
User) with an application. 

The first step for a person using ciny application is to 
be trained on how to interact with the application. The VU, 
however, can be trained to remember keystroke sequences that 
are repetitive, access system time and date information - 
never forgetting how to do it. The VU must be trained on how 
to react to cureror stops that an application makes. After 
being trained in how to react to the cursor stops /prompts, the 
VU will be able to operate the same functions in the 
application by itself. 



WO 95/28673 



Exec Procedure 



wo 95/28673 . PCr/US95/05009 

-12- 

To facilitate data input, the VU must be trained to 
prompt for Client data input. Clients are the terminals (RF 
handhelds, regular terminals, etc.) where an operator will 
enter data. The VU simplifies the operation of an application 
5 without requiring any programming changes in the application. 
The VU does this by automating the majority of the application 
cursor stops/prompts and only passing through to the Clients 
that information required for the particular task at hand. At 
each cursor stop in the application there is the option of 
10 prompting Clients for data or doing any of the other functions 
the menu bar allows. This option allows the VU to vary its 
response to a given application cursor stop. In this way, the 
present invention ensures that the can branch in the execution 
of steps. 

15 The following is a list of the basic steps of a typical 

Virtual User training session. 

Host Coxmection/logon/appllcation access 
Client Menu 

Host application access 

Automated navigation through access menus 
Prompting for Client data input 

Branching and error instruction based on Client data 
Looping to start the Client task over again or 
returning to a Client Menu 

By repeating these parts for whatever function you are 
trying to perform you can create simplified user input screens 



20 



1) 
2) 
3) 
4) 
5) 
6) 
7) 



25 
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for the portable terminal operators. Because the VU is simply 
navigating through an application the same way a person would 
only at 66MH2 (the clock speed of the computer) you can train 
it to do tasks that you would not expect a person to be able 
5 to perform in a timely manner* This simple concept allows you 
to put together functionality from several menu options of an 
application (even several different applications) and create a 
single operator screen that might not even exist in the 
original application. 

10 The details of each of these steps will become more clear 

through the following example training session. Note that the 
figures referred to in the example below show three important 
areas. Each figure represents the training screen of the 
present invention. At the top of the figures is the menu bar 

15 used to access' the function menus describe above, as 

. illustrated by Pig. A- a. In the middle of the figures is a 
model Client window labelled "CLIENT", reflecting the size and 
shape of the screen on the Client computer system, as 
illustrated by Fig. A- a. This screen is defined in the Spec 

20 file- An example Spec file is included as Appendix B. 

Finally, a "Host window shade", IsQDelled "HOST", will pop up 
as needed to show messages and prompts sent by the host. This 
is illustrated by Fig. I-c. The CLIENT, HOST and invention 
menus show the state of the system during the education 

25 process. When the education process is finished, the 
completed VU will operate as trained. 
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E:>cample Virtual User Training/Ed ucation Session 

The following is a simple application example as run by 
an actual user to illustrate the creation of a VU. Throughout 
the following text [] are used to represent selections that 
5 are to be selected using the pull down menus or to represent 
actual keys to press. For example: select [Start New Path] 
means to highlight the selection "Start New Path" in a pull 
down menu, press [end] means to press the end key, 

10 Step 0: (Fig. A- a through A-d) 

Access the Misc. menu and select the [Start New Path] . 
You must define the name of the path you are starting, this is 
important for looping and branching control. The path name 
specifies the point in the path for branch and loop access. 

15 In this example the name [main_menu] has been selected since 
this is the point at which the main menu will be displayed. 

Step 1: (Fig. B-a through B-b) 

Access the Client menu and select [Move Cursor] . This 
20 will set the cursor position in the client window* The 

default settings of row: 1 and col: 1 are have been selected. 
The cursor in the client window moves to the x,y position or 
1,1 as a result . 



25 Step 2: (Fig. C-a through C-b) 

Access the Client menu and select [Clear Screen] . The 
client screen is cleared as a result. 
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Step 3: (Fig. D-a through D-h) 

Access the Client menu and select [Send Message] . A 
submenu is displayed. Access the Type submenu and select 
[Text] and enter the message to be displayed on the client 
screen. In this example the message [Do you want to run the 
program y/n] is entered. The text "Do you want to run the 
program y/n" is now displayed on the client screen, split into 
lines of length appropriate to fit on the Client screen. The 
system is now ready to get a reply from the client. 

Step 4: (Fig, E-a through E-c) 

Access the Vars menu and select [Declare Variable] . A 
variable may be declared to store the response from the client 
to the question in Step 3. The variable name [answer] is 
entered. 

Step 5: (Fig. F-a through F-b) 

Access the Client menu and select [Get Reply] . Type 
[answer] [tab] [1] to enter "answer" as the variable the 
response from client will be stored into and sets the maximum 
length equal to one character. Note that the [baclcspace] now 
wor)cs as would normally be expected for editing mistalces. 

Step 6: (Fig. G) 

There are two options that need to be defined. The first 
is for a "y" or yes response, in general a typical training 
procedure would be to go through the "normal" path required to 
operate the application. In this case normal means "y", so we 
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will respond with a "y" , later in the example the training for 
the "n" can be entered. 

Step 7: (Fig, H-a through H-c) 

Access the Vars and select [Branch on Variable] . Type 
[answer] [tab] [y] [tab] [start^rw] [tab] , This defines the 
action: if the variable ."answer" equals the value "y" then 
proceed with the path named "start_rw". In the next menu 
select [d] to declare a pathname. At this time the "n" action 
may also be defined. Type [n] [tab] [exit] [tab] [d] which causes 
the path "exit" to be run when "answer" is equal "n" . 



Now the path named "start_rw" is created. 

Host Connection/logon/application access: for our 
training example we will be running both the application and 
the present invention on the same host. The application is 
therefore referred to as running on a local host: as opposed to 
running on a different or x-emote host. The following 
instructions apply to accessing an application via a pseudo 
terminal (PTY) on a local host only. You have to be logged 
onto the local host in order to run the present invention, 
therefore, with this method of connection you are not required 
to logon to the host prior to accessing the application. 
Refer to the applicable section for other connection methods. 
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PATH NAMES start_rw 

Step O: (Fig* I-a through I-c) 

Access the Host menu option. Once you are "in" the menu 
bar you may use the arrow keys to navigate. Use the down 
arrow to "pull down" the HOST window shade. Select [Connect 
Local (PTY)] by highlighting this option and pressing [enter]. 
You will now be prompted for Cozmnandx enter the keys you would 
normally use to access your application, for real world type 
[go_rw] , you can leave the Argument* line empty, press [end] 
to compete this step* You will notice that when you press 
[end] tlie Virtual User sends your keystrokes as a commcind line 
entry to the host. You should now see the first screen of the 
Real World application in the ^exmlnstl (middle) window. 

Alternate using [Exec Procedure] 

Step O: 

Access the Misc menu and select [Exec Procedure] . Type 
[go_rw] [end] . 

Automated Navigation through access menus: you are now 
ready to train the Virtual User how to navigate through your 
application. As you will see, the first step to perform at 
cursor stops is a "Wait for Host" step. This operation makes 
sure that the Virtual User and host application are 
synchronized with each other. If you try to send information 
to the host it will ask you to perform a "Wait for Host" 
first. The order that you prompt for Client input is entirely 
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up to you, this tutorial follows some basic guidelines. 



PATH NAME: nav_menus 

Step O: (Fig. J-a through J-c) 

Access the Misc menu and select (Start New Path] [enter] , 
Type [nav_menus] [end] . NOTE: "nav_menus" was chosen as a 
name because this path will navigate through the menus 
required to access our desired transaction* The underscore is 
required in the ncime, no spaces are allowed. 

Step 1: (Fig. K-a through K-c) 

Access the Host menu and select [Wait for Host] . Press 
[enter] and use the down arrow to select [automatic], press 
[enter] [enter] . You have now confirmed an automatic host 

synchronization for the string "o continue, or ESC to exi" to 

appear at the bottom of the Host screen. 

Step 2: (Fig. Li-a through L-c) 

Access the Host menu and select [Send to Host] . In the 
submenu select [Special Char(s)]. Press [enter], you should 
see <cr> in the window, press [•] [enter], edit using the [tab] 
key where necessary, press [end] to activate this step. You 
should see the application respond to the VU's carriage return 
with the next screen, now you need to enter your initials. 

Step 3: (Fig. M) 

We could easily "hardcode" a set of initials by using the 
sequence in step #2 or we could prompt the Client for "User 
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Initials". To prompt the Client for user initials, proceed as 
follows. Access the Client menu, use the down arrow to select 
[Clear Screen] . The Client screen should now be blank, you 
might not see any change because the old prompt "Real World 
(y/n)?» is hidden behind the terminal window. 

PATH NAHEt ltem_ trans far 

c 

step 0: (Fig. N-a through N-c) 

Access the Misc menu and select [Start New Path] . Type 
[item_transfer] as the name of the path. This path will 
prompt the Client with information to complete an item 
transfer transaction. The program will give you the option to 
linlc the last path "access" to the new path "item_transf er" . 
Press [n] to select "linlc to New Path". 

Step 1: (Fig. O) 

As in prior steps, we will clear the screen. Access the 
Client menu and select [Clear Screen] . The Client screen 
should now be blank. 

Step 2: (Fig, P) 

As above, access the Client menu and select [Move 
Cursor] . Select row 1 and coliamn 1. The cursor should now 
blink at the x,y position of 1,1 on the Client screen. 

Step 3: (Fig. Q-a through Q-b) 

Access the Client menu and select [Send Message] . Select 
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[Text] in the submenu. The message to be displayed on^ the 
Client screen is now entered* Enter [item:]. The prompt 
"item:" now appears on the Client screen. 

5 Step 4: (Fig. R) 

As before, access the Vars menu and select [Declare 
Variable] . The variable for storing the Client response to 
the item prompt is now declared. The name [item] is entered 
as the name of the variable. 

10 

Step 5: (Fig. S-a through S-b) 

Access the Client menu and select [Get Reply] . The 
replay from the Client will now be entered and stored into the 
variable "item". Type [item] [tab] [10] to enter "item" as the 
15 variable for the Client's response and a maximiim length of ten 
characters will be allowed. The menu bar will be replaced 
with Waiting for Client Input at Client or here. A valid item 
number may now be entered. 

20 PATH NAME: update_host. 

Step 0: (Fig. T) 

Access the Misc menu and select [Start New Path] . Type 
[update_host] as the new path name for this sequence of steps. 
This path will update the host with the response received 
25 under "item_transf er " path 
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Step 1: (Fig. U) 

As before, access the Client menu and select [Clear 
Screen] to clear the screen at this time* 

5 Step 2: (Fig. V) 

As before, access the Client menu and select [Move 
Cursor] . Select row l and column 1 as the new location. The 
cursor in the Client window should now be positioned at the 
x,y location of 1,1. 

10 

Step 3: (Fig. W) 

As before, access the Client menu and select [Send 
Message] . In the submenu select [Text] . Now the message to 
be displayed on the Client screen is entered. Enter 
15 [Processing Data] . The prortpt "Processing Data" is now 
displayed on the Client screen. 

Step 4: (Fig. X-a through X-b) 

Access the Host menu and select [Wait for Host] . Select 
[automatic] . This will now automatically synchronize the Host 
and Client. Note that error handling will be provided in the 
"None of the eibove" path of "item_error" and that the time out 
is set for 100 x .1 sec = 10 seconds. Therefore, on an error 
condition, if 10 seconds elapses without a response, then 
item error will be executed. 



20 



25 



Step 5: (Fig. Y-a through Y-b) 

Access the Host menu and select [Send to Host] . The 
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variable "item" will now be sent to the host. Select 
[Variable] from the submenu and type [item] as the variable to 
send to the host. Select [Special Char(s)] from the submenu 
and enter a [cr] , This will pass a carriage return to the 
5 Host. 

PATH NAME: item_error 

Step 0: (Fig. Z-a through Z-b) 

Because data was entered that caused the application to 

10 go into its error handling routine, the cursor is no longer at 
its. normal "next entry" position beside the second prompt 
"warehouse". Instead it is sitting at the bottom right hand 
comer of the screen with a message "Press ENTER , or F8". Note 
that the error message "Item not on file" is displayed at the 

15 left hand coimer of the screen. Step 4 of "update_host " had 
an error handling routine named "item_error" defined as the 
path to use if "none of the above" condition is true. 
Therefore, control has been passed to "item_error" to handle 
the error condition. Access Host and select [Wait for Host] , 

20 You have now confirmed an automatic host synchronization. 

Step 1: (Fig. AA) 

As before, access the Vars menu and select [Declare 
Variable] . This variable will store the host data that is 
25 currently in the "error window" on the host screen. Type 

[item_error] to declare the variable "item_error" which will 
be used in the next step. 
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Step 2: (Fig. BB) 

Select the Host window shade and select "save host data". 
Enter the variable declared in step 1 and use the arrow keys 
to move the "window" over the error message on the screen. 
Use the shift or "-" keys to increase or decrease the size 

of the "window" defined by the square brackets in the "Save 
Host Screen Data" box* 

Step 3: (Fig* CC) 

As before, access the Client menu and select [Clear 
Screen] . The Client screen should now be cleared. 

Step 4: (Fig. DD) 

As before, access the Client menu and select [Move 
Cursor] . Set the row to 1 and the colximn to 1. The cursor 
should move to the x,y location of 1,1 in the Client screen. 

Step 5: (Fig. EE) 

Select [Sound Tone] from the Client menu. A tone will be 
issued to the Client to notify the user of an error. 

Step 6: (Fig. FF) 

As before, access the Client menu and select [Send 
Message]. In the submenu select [Variable]. Enter 
"item_error" as the variable name and select [Special Char(s)] 
and define a carriage return and line feed so the next line of 
text does not overwrite the error message. Select [Text] and 
enter the message you want displayed on the Client screen. 



10 
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Select [Special Char(s)] and enter a carriage return, line 
feed and the last part of the message to be displayed. In 
this example, the text "<cr> <lf> Press ENTER to <cr> <lf> 
continue:". 

Step 7: (Fig. GG) 

As shown in the above steps, declare a new variable 
"answer" to get the ENTER key from the client in order to 
continue. 

Step 8: (Fig, HH) 

As demonstrated in the previous steps, get the Client 
reply . 



15 Step 9: (Fig. II) 

Wait for the Client response to the prompt. 

Step 10: (Fig. JJ) 

Wait for the' Host prior to sending the "answer" just 
20 entered from the Client. 

Step 11: (Fig. KK-a through KK-b 

The Host is now back at the item input prompt. Access 
the Misc menu and select [Loop] and connect this error path to 
25 the beginning of item_transf er to once again prompt the client 
for an item number. 
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Note that any error condition can be handled with this 
technique. It is equally* correct to use any of the "Possible 
Response" areas of the Wait for Host dialogue box. Therefore, 
5 additional "known" responses can be declared and "trained" 
in a similar manner as above. If you only want to train the 
VU for one error response that all conditions will use, then 
the "none of the cUbove" option is appropriate. 

Fig. 4 illustrates the interconnection of the various 
paths described in the above example. The VU trained as 
described above is now ready for use as an interface between 
the example application and a portable terminal. 

Path File Primitives 

The Path file specifies the sequence of steps and 
commands captured during the education process of the VU. 
Appendix A contains the Path file for the example VU 
illustrated above. The following primitives are used to 
record the host program behavior and the interaction with the 
human operator: 



$endact: 
$cl_connect : 
$cl_clear: 
$cl_tone: 
$cl_move: 
$cl_send: 
$cl_get : 
$cl_discon: 



terminate path file 
establish client connection 
clear client screen 
sound bell tone on client 
position client cursor 
send data to client 
get data from client 
break connection with client 
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$host_send: 
$host_connect ; 
$hos t_discon : 
$host_save: 
$host_sync: 

$declare: 
$parain: 
$set : 
$pipe : 

$new_path: 
$loop: 
$done : 
$ vbranch : 
$exec: 



-26- 

send data to host application 

establish connection to host application 

break connection with host application 

store data from emulation area 

monitor host operation cind compare against 

behavior database 

declare a storage variable 

modify as system parameter 

change the value of a variable 

establish transparent connection between 

client and host application 

begin a new secjuence of operations 

transfer control 

terminate a path 

conditionally branch on variable value 
execute a program procedure 



Spec File Primitives 

The Spec file captures the system dependant information 
for use by the VU. Appendix B contains the Spec file for the 
example VU illustrated above. The following primitives are 
supported in the "program level" interface: 



nop: no operation 

mark: label program location 

label: label program location 

begin: start a program structure 

end: end a program structure 



wo 95/28673 



PCTAJS95/05009 



10 



15 



20 



25 



write : 

display: 

send: 

f ile_write: 

get : 

read : 

find: 

if: 

else: 

endif : 

declare: 

param: 

set : 

eof : 

connect : 

disconnect: 

monitor: 

pipe: 

configure: 

sleep: 
capture : 
include: 
declare_action 
run_action: 
f ile_open: 



-27- 

output data to host or client 
output data to client 
output data to host 
output data to disk file 
input data from client 
input data 

locate data on emulator screen 
conditional execution 
conditional execution 
conditional 'execution 
declare storage variable 
set system configuration 
set variable's value 
terminate spec file 

establish connection to client or host 
break connection 

monitor data from host or client and 
compare against expected data 
transfer data between host or client and 
monitor 

set emulation, client I/O, or host I/O 

configuration 

delay 

enter training mode 
insert commands from sub- file 
: process and store a pathf ile 
execute pathf ile 
open a disk file 
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f ile_close: 


close a disk file 


spavm: 


execute a system comxnand as a subprocess 


goto: 


flow 


concroj. 


loop: 


flow 


control 


break ; 


flow 


control 


exit: 


flow 


control 


gosub: 


flow 


control 


return: 


flow 


control 


next : 


flow 


control 


then: 


flow 


control 


As disclosed 


by the 


example above, the operation of the 



existing program (s) is performed by the Virtual User program 
rather than an actual user. Thus the following functions are 
supported : 

15 1. The sequence and format of the data obtained from 

the actual user may differ from that required by the original 
program. 

2 . User data may be combined with data from other 
sources for presentation to the existing application. 

20 3. Data may be combined from multiple functions of a 

given application or multiple applications on a single host or 
even from multiple host computers for presentation to the 
user. Data may also be passed from one host application to 
another application with or without user interaction. This 

25 allows the generation of new, more complex functionality 
without writing new application prograins. 

4. The virtual user is trained with an interactive 
real-time, menu driven, manner. The present invention 
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monitors the actual behavior of the target host application 
and stores the details of this behavior for future reference. 
Many aspects of host program behavior are recorded including 
key elements of the actual data stream as well as the contents 
of the emulated screen displays. This behavioral database is 
used by the VU module to successfully operate the host program 
(including the detection and interpretation of error 
conditions) as well as being used as a source of data for 
presentation to the human operator and/or passed to different 
data entry screen within the application and/or different host 
applications. 

5. The VU module is able to detect unexpected actions 
by the host program and report them as exception conditions to 
the operator and/or learn the behavior and the required 
response . 

The present invention has been implemented in the ANSI C 
programming language* The present invention runs under the 
SCO Unix operating system (Santa Cruz, CA) running on a 486 
class workstation. The client portable terminal is any device 
capable of running an ANSI or VTlOO terminal emulator. Such a 
device is the Janus J2010 Handheld (Everett, WA) . 

It will be appreciated by those of ordinary skill in the 
art that the present invention can be embodied in other 
specific forms without departing from the spirit or essential 
characteristics thereof. The presently disclosed embodiment 
is therefore considered in all respects to be illustrative and 
not restrictive. 
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// Example Path File 
// 

DEC7AR answer 
PECVAR item_error 
5 DECVAR item 

NEW_PATH "main menu" 

ACTION $newj)ath "main_menu" 0 

10 ACTION $cl_move "main_menu" 1 
1 1 

ACTION $cl_clear "main_menu" 2 
Y 

ACTION $cl_8end "main_menu" 3 
15 N "Do you want to run" ; 

<cr> <lf> ; 
"the program (y/n) : " 
ACTION $cl_get "main_menu" 4 
answer N 1 
20 ACTION $vbranch "main_menu" 5 
answer 5 

Y 0 "start_rw" Y "y" 

Y 0 "exit" Y "n" 
N N 

25 N N 
N N 

EDISPATCH 

NEW^PATH "start_rw" 
3 0 ACTION $new_path "start_rw" 0 

ACTION $h_pty "start_rw" 1 

"go_rw" ; " " 
ACTION $loop "start_rw" 2 
35 Y 0 "nav_menus" 

NEW PATH "exit" 

ACTION $new_path "exit" 0 

40 NEW_PATH "nav menus" 

ACTION $new_path "nav_menus" 0 

ACTION $host_sync "nav_menus" 1 
DON 
45 N 2 

10 1 "H_" <esc> "[24;42H" 
24 14 26 "o continue, or ESC to exit" 
110 
EDISPATCH 

50 ACTION $host_send "nav_menus" 2 
N <cr> 

ACTION $loop "nav_menus" 3 
Y 0 "item_transfer" 

55 

NEW PATH "item transfer" 
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ACTION $newj5ath "item_transf er " 0 

ACTION $cl_clear "item_transf er" 1 
Y 

5 ACTION $cl_move "item_transf er" 2 

ACTION $cl_send "item^transf er" 3 

N "item: " 
ACTION $cl_get "item_transf er" 4 
10 item N 10 

ACTION $loop "item_transf er" 5 

Y 0 "update_host " 

NEW_PATH "update_host » 
15 ACTION $newj>ath "update_host " 0 

ACTION $cl_clear "update_host" l 
Y 

ACTION $cl_move "update_host " 2 
20 1 1 

ACTION $cl_send "update_host " 3 

N "Processing Data" 
ACTION $host_^sync "update_host " 4 
D 0 N ^ 
25 . N 1 

10 2 " " <esc> "[3;27H 

0 0 0 
0 0 0 

EDISPATCH 

30 ACTION $host_send "update_host " 5 
• N item ; 
<cr> 

ACTION $loop "update__host" 6 

Y 0 "item error" 



35 



NEW_PATH "item_error" 

ACTION $new_path "item_error' 



ACTION $host_syiic "item_error" 1 
40 DON 
N 1 

10 1 " " <^G><esc> "[24;79H" 
0 0 0 
0 0 0 

45 EDISPATCH 

ACTION $host_save "item__error" 2 

item_error 24 2 16 
ACTION $cl_clear "item_error" 3 

Y 

50 ACTION $cl_move "item_errcr" 4 
1 1 

ACTION $cl_tone "item_error" 5 
Y 

ACTION $cl_send "item_error" 6 
55 N item_error ; 

<cr> <lf> ; 
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15 



"Press ENTER to" ; 

<cr> <lf> ' 

"continue: " 
ACTION $cl_get "item_error". 7 

answer N 32 
ACTION $host_sync "item_error" 8 

DON 

N 1 

10 1 " 
0 0 0 
0 0 0 

ACTION $host_send "itein_error" 9 

Y 0 "itein_transfer" 
END_ACTION 
EOF 



<^G><esc> "[24;79H" 
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1, An apparatus for translating a first user interface from 
a preexisting application program running. on a host computer 
to a second user interface running on a client computer 
comprising: 

a computer adapted to monitor and capture interactions of 
a user using said application running on said host computer 
and further adapted to convert said interaction so that said 
interactions may be presented on said client conqputer; 

first communication means for communicating between said 
computer and said host computer; and 

second communication means for communicating between said 
computer and said client computer, 

whereby said first user interface is modified for use on 
said second user interface. 
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Hardwired Terminal 
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Monitor 



-CLIENT- 



ScreenShaper 
Copyright 1994 
Orchid Systems/ Inc. 



3. -5 - I 



wo 95/28673 



G/75 



PCT/US95/05009 



File Vars Host Client Misc. Menu 

Start New Path 
End Path 
Loop 

Exec Procedure 



CLIENT 

ScreenShaper 
Copyxlght 1994 
Orchid Syetems, Inc. 



fxc A-V) 
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File 



vara 



H St 



Client Misc. 



Assign PA^h Name 
Path KamttS 



Menu 

1 



-CLIBHT- 



ScreenShaper 
C opy right 1994 
Orchid Systems, Inc. 



File 
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vars 



U 9t 



AHMl(|n Path Mame 
Path Kame: main menu 
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V75 



Client Hiec, 



Menu 



-CLIBNT- 



5cra«n5hap«r 

Copyright 1994 
Orchid systems r inc* 
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File 



Vara 



Host 



Client 



Misc. 



Menu 



Cl«ar Screen 
Sound Ton« 
Movo Cursor 
send Message 
Get Reply 



CLIENT 

ScreenShaper 
Copyright 1994 
Orchid Syatems, Inc. 
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File varc Boot Client Misc. Menu 

. Move Client Curvoc 

Row; 1 
Col : 1 



-CLIBHT 

ScreenShaper 

Copyright 19^4 
Orchid Sy a tents, Xnc< 



Pv«, 6-6 

( 
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File vars Host Client Misc. Menu 



Clear Screen 
Sound Tone 
Move Cureor 
Send Message 
Get Reply 



— CLIBOT 

ScreenShaper 
Copyright 1994 
Orchid Systems/ Inc. 
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File Vars Hoat Clieat Misc. / Monitor 



CLIENT- 



P«6 C-b 
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Fixe 



vara 



Hoet 



Client Mi8c. 

Cl«&r Screen 
Sound Tone 
Move Curvux 
Send MKHHage 
Get Reply 



Menu 



-CLIENT- 



wo 95/28673 



PCT/US95/05009 



File Vare Host Client Miec • Menu 

Send to Client 

Type Value 
Data a t <empty> 
Data 2: <einpLy^ 
Data 3 ; <«inpty> 
Data 4: <empty> 



CLIENT 
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rile vare Host Client Misc. Menu 



Send 


to 


Client 




Ddta 
Data 
Data 
Data 


li 
2: 
3: 
4t 


Text 

1 Special Char(e) 
Variable 


Value 



CLIENT- 




A 
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File 



vara 



Boat, 



Client 



Hlac . 



Menu 



Sand Client 
Enter Data 

Dcit 

Dat Text Strings 
Dat 

Dat* — 



1^ 4.^- ^ 



Pl6 b-A 
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Fll 



Vara 



Host 



Client 



Misc. 



Menu 



Send to Client 



uata 1; 
Dat;a 2: 

Pat a 



3t 
4: 



<«mpty> 
Text 

Special Char ( s ) 



Value 

uo you want to run, 



CLIENT- 
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Vara 



aos^ 



Client 



Misc. 



Menu 



Send to client 
Enter Data 



Dat 
Dat 

Dat 



Text Stringjthe prcgram (y/n) : 



CLIENT- 



^16 0-4 
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File VarB Host: Client: Misc. 

Send to Client 



Menu 



Dara 12 

Daiia 2 1 

Data 3: 

Data 4; 



Text 
Special 
Text 
<ejiipty> 



Char(a) 



Value 

Do you want to run 

<er> <1£> 

the program (y/n)s 



CI-IEHT- 
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File vare 



Host Cli nr Mice, Monxtor 



CLIENT 

Do y ou wa n t. t. o run 
the piTogram (y/n) ; 



fi^ D-K 
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File Vars Host Client Miac. M 



Ueclaro Variable 
Set variable 
Branch oh Variable 



I Cl.TEWP 

Do you want to run 
the program (y/n): 
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File Var» Hoet Client Mi»c. Menu 

Decilare Hew Variable 
Variable; 



CLIEMT 

Do you wan^ to run 
the program (y/n) ; 
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Fil Var» host Client Misc, Menu 

Declare Kew Variable 
Variables anttwe^; 



CLIENT 

Do you want to run 
the program (y/n): 
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rile 



vars 



BOBt 



Client 



Misc. 



Menu 



Clear Screen 
Sound Tone 
Move Cursor 
Send Mefl«age 
Get Reply 



CLIENT 

Do you want, to run 
the program (y/n); 
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File 



Vars 



Host 



Client Miac. 



Get Client Raply 

Variable Kame: answer 
Max Lent 1 



Menu 



—client- 



Do you want to run 
the program (y/n) « 
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Fxle VAX'S uoat Client Misc. Monitor 



CLIENT 

Do you want to run 
the program (y/n) : y 



( " - " ' L 
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rile vara ^HOBt Client Misc. Menu 

Declare Variable 
Set Varia^bie 
Branch on Variable 



CliXBNT 

Do you want to run 
the program (y/n)s y 



■z' 
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File Vara ilost Client Mi3c • Menu 



Dispatch oil Variable 

Variables answer 

Value Match Path Kaaa Ko. 

1. eq y etart^rw o 

2. eq 0 

3. eq 0 

4. eq 0 
ricjt. eq 0 



-CLIENT 

Do you want to run 
the program (y/n)xy 
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vara 



Host: 



Client 



Ui 
Va 



1. 
2. 
3. 
4. 



Fath atart^rw doesn't exist 

Declare Pathname 
Respeclfy Fathname 
C* Cancel Operation 

Select t»#J^fC]: R 



eq 
not eq 



Ko* 
0 
0 
0 
0 
0 



CLIENT 

Do you want to run 
the prograzD (y/n)sy 



■3 -In. ^ 



Ft6 t^-<^ 
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rile 



vars 



UOBt, 



Client 

I 



Mi.0c . 



Menu 



Connect Local (PTY) 
Connect Local (Pipe) 
Connect via TELNET 
CoiinucL via Serial 



-CLIEM'i^ 



Do you want to run 
the program (y/n) jy 



Be 3: -A 
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^xlB Vara Host Client Misc. M«nu 

Connect to Host via PTY 

Cottimaadt 9^^^ 
Argument : 



CLIENT 

Do you want to xrun 
the program (y/n):y 
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File Vara Host Client Misc. Monitor 



— HOST 

lealWorld Software 
/ rsion 6«s 

3ata Look Up Utility 3.0 (C) 1992^ 1993 by DataTech 

(C) copyright 1986, 1987, 1988, 1989, 1990, 1991, 1992 by RealWorld Corporation. 

ALL RIGHTS RESERVED. Ho part of this material may be reproduced or trans- 
mitted in any form or by any meane, electronic, mechanical or otherwiae, 
without written permicsion from RealWorld Corporation, 



This software may be used only as authorized by a valid "RealWorld 
Software License". if you have not read and agreed to such license, 
do not continue. If you need another copy of the license, contact 
your supplier or RealWorld Corporation at Loudon Road, Concord, 
New Hampshire 03301 USA. (Telephone 800-678-6336.) 



Press ENTER -to continue, or ESC to exit 



0 
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File 



vara 



Host 



CXient. 



Mi.ec • 



Menu 



Start New Path 
End Path 

liOOp 

Exec Procedure 




(C) Copyright 1986 r 19B7 , 1988, 1989, 1990, 1991, 1992 by RealWorld Corporation 

ALL RIGHTS RESBRVED* No part of this material may be reproduced or trans-^ 
mitred in any form or by any meaiiH, «ilttcLi.uialu , m«uh«Lnxcal or otherwise, 
without written permiaelon from RoalWorld Corporation. 



This software may be used only as authorized by a valid **RealWorld 
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